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Stable  Adaptive  Controller  Design  - Direct  Control 
Kumpati  S.  Narendra  and  Lena  S.  Valavanl 

1.  Introduction:  The  theory  of  adaptive  observers, which  simultaneously  estimate 
the  state  and  parameters  of  an  unknown  linear  time-invariant  system, is  well  under- 
stood at  the  present  time.  The  original  observers  were  proposed  in  [1]  and  [2] 
and  were  later  generalized  in  [3].  The  extensions  to  multivariable  systems  [4], 

[5],  the  analysis  of  related  stability  questions  [6^[7]  and  the  study  of  the  speed 
of  response  of  the  observer  [8]  have  provided  valuable  insight  into  the  design  of 
such  systems.  Further,  it  has  been  shown  that  all  the  results  can  be  extended  in 
a straightforward  manner  to  discrete  systems  [9], 

Contrary  to  the  expectations  of  research  workers  in  the  field,  the  solution 
of  the  control  problem  did  not  follow  directly  from  the  solutions  obtained  for 
the  adaptive  observer.  The  principal  difficulty  lies  in  the  assumption  that  the 
input  and  the  output  of  the  observed  plant  are  uniformly  bounded.  As  described 
in  [10] , this  is  not  assured  in  the  control  problem,  since  it  is  precisely  the 
question  of  stability  of  the  overall  feedback  system  that  has  to  be  resolved  in 
this  case.  Further,  the  structure  of  the  observer  can  be  chosen  by  the  designer 
so  that  the  necessary  signals  can  be  fed  into  any  part  of  the  observer  to  generate 
the  desired  estimates.  In  contrast  to  this,  in  the  control  problem,  only  the 
input  to  the  unknown  plant  can  be  affected  and  this  poses  a serious  constraint 
in  its  resolution. 

In  this  paper  the  adaptive  control  problem  for  the  case  of  an  unknown  plant 
with  a single  input  and  a single  output  is  considered.  The  plant  is  assumed  to  be 
linear  and  time-invariant  and  a differentiator -free  controller  is  to  be  designed  to 
generate  a control  input  u(t)  so  that  the  output  of  the  plant  evolves  asymptotically 
towards  that  of  a given  model . .^Earlier  work  in  this  field  is  due  to  Monopoli  [11] 
who,  following  the  approach  adopted  in  adaptive  observers  [3],  suggested  an  ingenious 
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scheme  which  involves  the  use  of  an  augmented  error  model.  The  approach  developed 
in  this  paper  has  the  general  flavor  of  the  method  used  in  [11]  though  the  actual 
structure  of  the  controller  is  different.  The  latter  provides  the  necessary 
motivation  for  the  changes  that  have  to  be  introduced  in  the  controller  structure 
as  well  as  the  adaptive  laws  on  the  basis  of  the  prior  information  regarding  the 
plant  transfer  function.  In  section  6,  the  various  arguments  used  in  the  design 
of  the  controller  are  explained  in  terms  of  a single  arbitrarily  located  control 
parameter  to  indicate  the  generality  of  the  approach  and  its  potential  application 
in  other  control  situations. 

Perhaps  the  most  crucial  question  that  has  to  be  answered  in  the  context  of 
the  adaptive  controller,  as  in  the  adaptive  observer,  concerns  the  stability  of  a 
set  of  non-autonomous  error  differential  equations  which  assures  that  all  the 
parameters  are  bounded  and  that  the  output  error  tends  to  zero.  This  point,  on 
which  the  entire  design  is  based,  has  not  received  the  careful  attention  it  deserves 
in  [11]  and  hence  the  conclusions  drawn  there  are  not  justified.  The  principal 
contributions  of  this  paper  are  a systematic  procedure  for  the  design  of  adaptive 
controllers  and  the  clarification  of  the  related  stability  problems.  For  cases 
where  the  plant  has  n poles  and  (n-1)  or  (n-2)  zeros,  the  controller  is  shown  to  be 
uniformly  asymptotically  stable.  In  cases  where  the  plant  has  (<)n-3  zeros,  the 
necessary  modification  of  the  method  raises  questions  regarding  the  boundedness 
of  the  outputs  of  the  model  and  the  plant  even  when  the  output  error  is  bounded. 

This  problem  is  formulated  in  a more  general  setting  in  terms  of  the  behavior 
of  signals  in  a feedback  loop  when  certain  known  linear  transformations  of  these 
signals  are  bounded.  It  is  conjectured  in  the  paper  that  under  the  above  conditions 
the  closed  loop  signals  will,  in  fact,  be  bounded, thus  assuring  uniform 
asymptotic  stability  of  the  adaptive  system.  While  the  validity  of  the  con- 
jecture remains  at  present  an  open  question,  its  verification  will  justify  the  use 
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of  the  relatively  simple  controller  structure  suggested  here  and  result  in  the 
complete  resolution  of  the  adaptive  control  problem. 

Indirect  and  direct  adaptive  control  of  an  unknown  plant  were  discussed  in 
[10].  In  the  former,  an  observer  is  employed  to  estimate  the  parameters  of  the 
plant  and  these  estimates,  in  turn,  are  used  to  determine  the  control  parameters. 
In  direct  control,  the  parameters  are  adjusted  directly,  without  an  intermediate 
identification  stage.  In  this  paper,  only  direct  control  is  discussed;  indirect 
control  as  well  as  the  relation  between  the  two  approaches  will  be  discussed  in  a 
later  paper. 

Simulation  results  are  included  mainly  at  the  end  of  the  paper  for  different 
control  situations  of  varying  degrees  of  complexity. 

2.  Statement  of  the  Problem: 

The  plant  P that  is  to  be  controlled  is  completely  represented  by  the  input- 
output  pair  {u(t),yp(t>}  and  can  be  modeled  by  a linear  time-invariant  system  de- 
scribed by  the  differential  equations: 


x = A x + b u(t) 
P P P P 
.T 

y = h x 
P P 


(1) 


where  A is  an  (nxn)  matrix  and  h and  b are  n-vectors.  The  transfer  function  W (s) 
P P P 

of  the  plant  may  be  represented  as 


T —1  A ^ ^ (s) 

W (s)  - hT(sI-Ap)  * -VST  • 

P 


(2) 


W (s)  is  strictly  proper  with  Z (s)  a monic  Hurwitz  polynomial  of  degree  m($n-l) , 

P P 

R (s)  a monic  polynomial  of  degree  n,  and  k a constant  gain  parameter.  We  further 
P P 

assume  that  only  m,n  and  the  sign  of  k are  known  for  use  in  the  design  of  the 

P 

controller.  (The  sign  of  k is  assumed  to  be  positive  throughout  this  paper.) 

P 

A model  M represents  the  behavior  expected  from  the  plant  when  it  is  augmented 
with  a suitable  controller.  The  model  has  a reference  input  r(t)  which  is  piecewise 


Since  the  dynamic  controller  to  be  designed  should  be  free  of  differentiators 
it  follows  that  the  plant  together  with  the  controller  (with  constant  parameters) 
would  have  a transfer  function  with 


(number  of  poles)  - (number  of  zeros)  2 (n-m)  (5) 

Hence,  to  have  a well  defined  problem,  the  model  transfer  function  should  also  satis- 
fy inequality  (5).  For  the  sake  of  simplicity,  we  shall  assume  in  the  following 
sections  that  r = m and  that  the  equality  is  satisfied  in  eq.  (5). 

The  design  method  proposed  in  this  paper  calls  for  an  operator  L(s)  such  that 

the  transfer  function  W (s)L(s)  is  strictly  positive  real.+  Once  again,  for  the 

M 

sake  of  simplicity  and  with  no  loss  of  generality,  it  is  assumed  that  L(s) , a poly- 
nomial of  degree  (n-m-1) , exists  so  that  this  condition  is  satisfied.  [It  is  ob- 
vious that  a rational  function  L^(s)  with  a numerator  polynomial  of  degree  (n-1) 
and  denominator  polynomial  of  degree  m exists  such  that  W^(s)L(s)  is  positive  real. 
Such  a function  can  be  used  in  place  of  the  polynomial  L(s).] 

^ Throughout  the  paper  both  differential  equations  and  transfer  functions  are  used 
in  the  arguments  and,  depending  on  the  context,  's'  is  used  as  a differential 
operator  or  the  Laplace  transform  variable. 
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The  adaptive  control  problem  may  now  be  stated  as  follows: 

Given  a plant  P with  input-output  pair  (u(t),yp(t)}  described  by  (1)  and  (2) 

and  a model  M({r(t),y  (t)})  described  by  (3)  determine  a suitable  control  function 

in 

u(t)  such  that 

lim  | e ( t)  | = lim  |y  (t)  - yM(t)  | = 0 (6) 

t-HX,  1 t-HX,  P M 

The  solution  to  the  above  problem  may  be  broadly  divided  into  two  parts.  The 
first  part  (section  4)  is  algebraic  in  nature  and  addresses  itself  to  the  question 
of  realizability  of  a suitable  controller  structure.  Using  such  a structure,  con- 
stant values  of  the  controller  parameters  can  be  shown  to  exist  such  that  condition 
(6)  is  satisfied  for  any  arbitrary  input  r(t).  The  second  part  (sections  5 and  6) 
is  analytical  in  nature  and  deals  with  the  adaptive  scheme  for  updating  the  param- 
eters so  that  the  error  e^(t)  in  (6)  evolves  asymptotically  to  zero. 

3.  Mathematical  Preliminaries: 

The  theory  of  adaptive  observers,  as  shown  in  [3],  may  be  developed  entirely 
on  the  basis  of  three  prototypes  which  indicate  how  the  parameters  of  a system  can 
be  adjusted  to  match  those  of  a model  using  only  input-output  information.  We 
state  below  several  lemmas  which  are  useful  in  the  control  problem  and  which  are 
derived  from  the  third  prototype. 

a)  Lemma  1:  Given  a stable  (nxn)  matrix  A,  a symmetric  (mxm)  positive  definite 
matrix  T,  vectors  h,d  e IRU  and  u>(t ) : [0,  °°)  •»  |Rm  whose  elements  are  bounded  and 
piecewise  continuous,  the  equilibrium  state  cf  th<*  set  of  (n+m)  differential 
equations 

• T 

e ■ Ae  + d$  u> 

ex  - hTe  (7) 

$ * -re^aj 


* 


T “1 

is  stable  and  |e^(t)|  + 0 as  t + “ if  the  transfer  function  h (sI-A)  d is 
strictly  positive  real  (SPR) . Further,  if  u>(t)  is  "sufficiently  rich", 

lim  H<J> (t)||  « 0. 

t-H» 

Proof : The  proof  follows  directly  by  using  a Lyapunov  function  candidate 

V(e,<f>)  = j[eTre  + 4>Tr_14>]  with  P = PT  > 0. 

T -1 

From  the  Kalman-Yacubovich  lemma  it  is  known  that  if  h (sI-A)  d is  strictly 
positive  real,  a matrix  P exists  such  that 

T T 

A P + PA  = -qq  - eL 

Pb  = h 

T 

for  some  vector  q,  matrix  L = L >0  and  e > 0. 

This,  in  turn,  yields  a time  derivative 

V(e,<j>)  = - \ eT(qqT  + eL)e  $ 0 

Hence,  the  equilibrium  state  is  uniformly  stable  and  e(t)  and  <f>(t)  are  bounded  if 

e(t0)  and  are  bounded.  Since  u>(t)  is  bounded,  from  [7],  lim  ||e(t)||  = 0. 

^ ^ £-*<» 

This,  in  turn,  yields  from  equation  (7)  lim  l|^(t)ll  = 0 and  lim  <J>^(t)o>(t)  = 0. 

£-HX>  t^00 

If  uj(t)  is  "sufficiently  rich"  as  defined  in  [7],  the  above  two  conditions 
imply  lim  |l<Kt)||  = 0. 

t-+® 

Comment : It  is  seen  from  Lemma  1 that  ||e(t)|j  and  II d> ( t)||  are  bounded  with  no  con- 

straints on  u(t).  The  boundedness  of  ||w(t)|j,  however,  assures  the  convergence  of 
||e(t)l|  to  zero.  Further, the  "richness"  of  ui(t)  results  in  4^(0  converging  to  zero. 

In  Lemma  1 u(t)  was  an  independent  input  vector.  If,  however,  it  is  generated 
as  a feedback  signal  using  a stable  system  with  e^(t)  as  an  input,  we  obtain  the 
following  corollary. 


-7- 


IT 

Corollary  1:  If  in  Lemma  1,  the  condition  on  a>(t)  is  replaced  by  the  differential 
equation 

to  = A u>(t)  + be^ 

. where  A is  an  (mxm)  stable  matrix  and  b e IRm  then 

lim  | e ( t) | = 0 
t-*» 

Proof:  The  boundedness  of  |e^(t)|  assures  the  boundedness  of  ||w(t)l|  since  A is  a 
stable  matrix.  By  Lemma  1 this  assures  that  |e,(t)|  + 0 as  t + *. 

Corollary  1 implies  that  the  set  of  equations  (7),  (8) 

. I'  • T • T 

e = Ae  + d<£  w;  <j>  — — T(h  e)w;  u — A u>  + bh  e 

is  stable  and  l|e(t)||  -*■  0 as  t -*■ 
b)  The  Operator  ) : 

In  the  development  of  the  solution  to  the  control  problem,  an  operator  PL(0) 
is  found  to  play  an  important  role.  If  L(s)  is  a Hurwitz  polynomial  of  degree  n^^ 
in  the  differential  operator  ’s’  and  6(t)  is  a bounded  differentiable  function  of 
time,  the  operator  P^(9)  is  defined  as 

PL(0)  = L(s)e(t)L_1(s)  (9) 

(i)  It  follows  directly  that  PL(0)  is  linear  in  6.  PL(c0)  = cPL(0); 

PT  (a0,  + 89-,)  = aPT  (6,)  + 0PT  (0O)  for  all  real  numbers  a, 8 and  c. 

LI  2.  L 1 L Z 

it  * * * 

(ii/  When  0(t)  = 0 , where  0 is  a constant,  P^(0  ) * 0 • Hence, 

P (0)  - 0*  - P (0-0*).  If  0(t)  = 0*  + <(>(t) 

L L 

PL(0)  - 0 = PL<*)  - ♦ 

(iii)  a)  If  L(s)  - s + a , PL(0)  = [0+0L_1(s)] 

i 
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b)  If  L(s)  = s2  + as  + b , PT (6)  = [6  + 6 + (s+a/2)0  -X^-  ] 

L L(s)  L(s) 


c)  If  L(s)  is  any  Hurwitz  polynomial  of  degree  n , P (0)  can  be  expressed 

X L 


P (0)  - 0 + £ tB,(s)0(t)A,(s)]L~1(s) 
L i=l  1 1 


where  B^(s)  and  A^(s)  are  polynomials  of  degree  ( i— 1)  and  (i)  respec- 


tively. The  expression  given  in  (10)  is  not  unique.  A useful  expan- 
"l 


sion  when  L(s)  = £ (s+Z.)  in  terms  of  B (s)  and  A, (s)  is 

j=l  J 1 

i "l-1 


B (s)  = n (s+Z.)  ; A = n (s+z  ) 

1 j=2  J 1 j-i  J 


i — 1,2, .. . ,n 


and  B (s)  = 1. 


(iv)  If  W(s)  is  a stable  transfer  function  with  m poles  and  n zeros  and 


n $ n - m - 1,  W(s)P  (6)  is  a linear  bounded  operator.  This  follows 

X L if 


directly  from  the  facts  that  L(s)  is  Hurwitz,  0 is  bounded  and  W(s)L(s) 


is  a stable  transfer  function. 


c)  Lemma  2 : If  Q(s)  and  T(s)  are  monic  polynomials  of  degree  n and  m(fn-l) 


respectively  which  are  relatively  prime,  polynomials  P(s)  and  R(s)  of  degree 


(n-1)  with  P(s)  monic  exist  such  that  PQ  + RT  can  be  made  equal  to  any  arbi- 


trary monic  polynomial  of  degree  (2n-l) . 


Proof:  Since  Q(s)  and  T(s)  are  relatively  prime,  polynomials  A(s)  and  B(s)  of 


degrees  (m-1)  and  (n-1),  where  m £ 1,  exist  such  that 


AQ  + BT  = 1 


If  Q(s) 


I q s and  T(s) 
i-0 


i 

Z t.s  ,(q  » t l),the  above  equation  can  be 

i-o  1 n m 
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satisfied  if  the  (n+m-2)x(n-Hn-2)  matrix  C given  by 


1 

0 

0 0 

0 1 

1 

0 

0 0 

0 

0 

qn-l 

1 

• ' 

Cm-1 

1 

0 

• 

qn-l 

1 

• 

rt 

S 

1 

H-* 

0 

• 

• 

• 

• 

0 

• 

• 

1 ■ 

co 

• 

0 

qo 

• 

qn-l 

0 

co 

1 

0 

qo 

• • 

• 

0 

0 

Cm-1 

0 

0 

• • 

^ 1 

0 

0 

Cm-2 

0 

0 

0 1 
J 1 

0 

0 

t . 
m-k 

m-1 

n-1 

J 

where  0 $ k i m, is  nonsingular.  This  is  assured  if  Q and  T are  relatively  prime. 
Let  M be  the  arbitrary  polynomial  of  degree  (<)2n-l.  Then 


MAQ  + MBT  = M 
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4.  The  Structure  of  the  Adaptive  System: 

As  mentioned  in  section  1,  we  first  require  the  adaptive  controller  to  possess 
enough  freedom  so  that  the  control  problem  has  a solution.  This  implies  that  for 
some  constant  values  of  the  controlled  parameters  the  corresponding  transfer  func- 
tion of  the  controlled  system  exactly  matches  that  of  the  model. 

The  Controller  Structure:  The  basic  structure  of  the  adaptive  system  is 
shown  in  Figure  (1) . This  structure  is  suitably  modified  for  the  different  control 
situations  considered  in  section  5.  The  controller  consists  of  a gain  k^,  and 
auxiliary  signal  generators  F^  and  F^  F contains  (n-1)  parameters  c^(i  = l,2,...n-l) 
and  F2  contains  n parameters  d^(i  = 0,  1,2, . . . ,n-l) . Together  with  k^  these  con- 
stitute the  2n  adjustable  parameters  of  the  controller,  which  are  denoted  by  the 
elements  of  a parameter  vector  0(t). 


0 (t)  = [kQ(t)  .c^t)  ....  .c^Ct)  ,d()(t),d1(t)...dn_1(t)] 


- [k0(t),cT(t),d0(t),dT(t)] 

F^  and  F^  are  described  by  the  (n-l)^  order  vector  differential  equations 


II 

r— 1 

• > 

Av^  + bu 

w<»  = 

cTv<1> 

^2>  = 

Av(2)  + by 

1 

W(2>  = 

doyP  + dTy 

T 

and  b 

= [0,0,.... 

(12a) 


(12b) 


where  A is  an  ((n-l)x(n-l))  stable  matrix,  F^  and  F^  have  transfer  functions  W^(s) 
and  W^(s)  respectively  for  constant  values  of  the  parameters  c^  and  d^  (i  * 1,2,... n-1; 
j * 0,1, . . .n-1) . 

Vs>  ‘ ■ 5w 

(13) 

V>  ■ do  + 4 "o  + sHf 


Basic  Structure  of  the  Adaptive  System. 
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If  (A,b)  is  in  companion  form,  and  (i  * l,2,...,n-l)  represent  the  coefficients 

n-i-i  X -1  T —1 

of  s of  the  numerator  polynomials  of  c (sI-A)  b and  d (sI-A)  b. 

For  constant  values  of  6,  the  overall  transfer  function  of  the  controlled 

system  is  W(s)  where 

kowP(s)  kokpZP(s)N(s) 

1 + W.  (a)  + W (s)W,(s)  = [N(s)  + C(s)]R  (s)+k  Z (s) [D(s)+d_N(s)  ] <14) 

1 p 2 P P P 0 


W(s) 


W(s)  as  given  in  (14)  has  (3n-2)  poles  and  (2n-Hn-2)  zeros  of  which  (n-1)  are  common. 

•k 

Further,  by  lemma  2 it  is  known  that  a constant  parameter  vector  0 exists  such  that 
W(s)  = WM(s),  which  implies  there  are  (n-1)  additional  pole  and  zero  cancellations. 
From  (14)  it  is  seen  that  the  poles  of  the  auxiliary  signal  generators  are  also  zeros 
of  W(s).  In  order  that  the  overall  transfer  function  have  the  same  zeros  as  the 
model,  N(s)  is  chosen  to  contain  ZM(s)  as  a factor. 


If  the  vector  <u(t)  is  defined  as 


J(t)  - [r(t),v(1)(t),yp(t),v(2)(t)] 


the  overall  system  can  also  be  represented  as 


A i 0 i 0 

__P_  l_  J___| 

0 ! A |_0 

T ' l 

bh  I 0,  A 

• f 


X 

p 

p 

’v<« 

« 

- 

X 

r b 

p 

p 

;<« 

+ 

b 

0 

[eT(t)ui] 


(15) 


, T 

y = h x . 

P P 

Denoting  0(t)  = 0 + $(t)  the  state  equations  (15)  can  also  be  written  as 

x = A x + b [k  r + <J>T(t)uj] 
c cO 


(16) 


where 


,T  - [„pT,v<»T,v<2>Tl 


r * T 

A +dnbh 

P 0 P 

1 *T 

' +b  c 1 

' P 

1 *T 

i +b  d 1 

_i  . p_  - 

. ' 

A - 

c 

* T 

+bdQ  h 

*T 

1 A+bc 

• *x 

1 +bd 

* bc  “ 

b 

T 

bh 

i 0 

1 

I A 

_0 

T tb 

and  b ■ [0,C,...,1]  is  an  (n-1)  order  vector. 
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When  <Kt)  - 0 and  9(t)  = 0 » equation  (16)  also  represents  the  model.  If  x is  the 

me 

state  vector  of  a nonminlmal  representation  of  the  model, 

x - A x + b k *r  (17) 

me  c me  c 0 

T T (1)"^  (2)^ 

where  x *=  (x  ,v  >v  } and  the  (3n-2)  elements  of  x correspond  to  those  of 
me  mm  m me 

the  plant. 

We  note  that  the  plant  is  not  known  and,  hence,  the  model  cannot  be  realized 
in  the  form  shown  in  equation  (17).  However,  (17)  is  used  only  for  purposes  of 
analysis  of  the  error  equations  and  not  to  generate  any  adaptive  signals. 

The  Error  Equation: 

The  error  equations  between  model  and  plant  may  now  be  expressed  as 

• T 

e = A e + b (t)co] 

c c n V 


where  e(t)  - x(t)  - x (t)  ,h  and  b are  (3n-2) -vectors,  h1  - [1,0,0, ... ,0] , 

me  c c * c 

T T T 

b ■ [b  ,b  ,0].  The  error  transfer  function  W (s)  is  given  by 
c p 0 

1 k 

W (s)  * h*(sI-A  )~\  - r*  W (s).  (19) 

e c c c k,j  M 

T 

Hence  the  error  equations  can  be  represented  as  shown  in  Figure  2,  with  <f>  (t)oi(t) 
as  the  input  to  a system  with  transfer  function  Wg(s) . It  is  worth  noting  that 
the  signals  to^(t),  (i  = 1,2, . . . ,2n),  are  derived  from  r(t),  the  reference  input,  u(t),  the 
control  input,  and  y^(t),the  output  of  the  plant. 

Modification  of  Controller  Structure: 


In  the  representation  of  the  controller  that  we  have  used  thus  far,  if  every 

element  0^(t)  of  the  parameter  vector  8(t)  is  replaced  by  PL(ep  (with  L-a  polynomial 

of  degree  (n-m-1)  in  ’s'), it  follows  directly  that  (i)  e(t)  = 0 would  make  the  overall 

transfer  function  W(s)  equal  to  W (s), 

and  (ii)  the  error  equations  can  be  represented  by  a linear  time -Invariant 

dynamical  system  with  (3n-2)  + 2n(n-m-l)  states,  a single  output  e1  and  a single 
2n 

input  ue(t)  * ^2^  \(t)  ^i (t)  • T*16  transfer  function  from  u£(t)  to  e^(t)  is  now 


Figure 
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K 

L(s)W^(s)  and  the  signals  C^(t)  in  Figure  (3)  are  given 
M -1 


C±(t)  = L (s^^t) 


by 

(i  = 1,2, . . . ,2n) . 


(20) 


The  proper  choice  of  L(s) , the  realization  of  P (0)  in  the  system  without  using  dif- 

L 

ferentiators  and  the  proof  of  stability  of  the  modifieJ  system  form  the  essence  of  the 
solution  to  the  control  problem. 

5.  The  Control  Problem: 

The  complexity  of  the  solution  to  the  control  problem  depends  to  a large  extent  on 

the  prior  information  that  is  available  regarding  the  transfer  function  of  the  plant  - in 

particular,  the  order  'n'  of  the  plant  and  the  number  m of  zeros.  While  our  aim  is  to 

develop  a controller  for  the  general  case,  for  convenience  of  exposition  we  shall  consider 

the  following  four  cases  of  increasing  generality  where  it  is  known  that  W (s)  has: 

(i)  (n-1)  zeros  and  n poles. 

(ii)  (n-2)  zeros  and  n poles. 

(iii)  m(<n-3)  zeros  and  n poles  and  a known  gain  k^ . 

(iv)  m(<n-3)  zeros,  n poles  and  an  unknown  gain  k . 

The  first  case  with  (n-1)  zeros  and  n poles  has  been  known  for  a long  time.  It  has 

been  explicitly  used  in  adaptive  observer  theory  by  Narendra  and  Kudva  [3]  and  in  the 
control  context  by  Monopoli  and  Gilbart  [13].  The  results  presented  for  the  second  case 
are  new  although  a less  general  version  appears  in  [11] . The  modification  of  the  con- 
troller structure  as  discussed  in  the  previous  section  enables  the  same  concepts  to  be 
extended  to  the  general  cases  (iii)  and  (iv). 

Case  (i):  W (s)  with  (n-1)  zeros  and  n poles: 

E 

A model  is  chosen  which  has  a strictly  positive  real  transfer  function: 

„ , , , T -1  WS) 

WM(.)  . h (.I-A,,)  bm  - -jgjj- 

In  this  case  L(s)  = 1 and  the  parameter  error  vector  <p ( t ) is  updated  in  equation  (8) 
according  to  the  control  law 

T 

l - e - -re1(t)w(t)  r = r > o (21) 

By  lemma  1 the  state  error  e(t)  and  parameter  error  <f>(t)  are  bounded.  Further,  since  the 

state  of  the  model  is  bounded,  it  follows  that  the  vector  w(t)  is  bounded  so  that 
e(t)  + 0 as  t + « or  |c  (t)|  + 0 as  t + ®. 

* This  is  for  convenience  of  analysis  only;  if  the  model  is  not  positive  real  the  same 
analysis  can  be  used  by  proper  prefiltering  of  the  reference  signal. 


Figure 
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Case  11:  wp(s)  with  (n-2)  zeros  and  n poles: 

In  this  case, a model  Is  chosen  with  (n-2)  zeros  and  n poles  such  that 
L(s)Wm(s)  is  strictly  positive  real  with 

L(s)  = (s+p) 

From  section  3b  with  L(s)  = (s+p),  the  operator  P (<J>)  = L<f>L  * is  functionally 

L 

equivalent  to  { 4>  ( t)  + <t»(t)  L }.  Since  4>(t)  is  determined  completely  by  the  adap- 
tive law,  it  is  a known  signal.  The  adaptive  controller  structure  has  the  form 

shown  in  Figure  4.  Every  parameter  0.(t)  is  now  replaced  by  the  operator  P (0  ) 

1 L 1 

and  the  control  input  u(t)  is  given  by 

2n  . 1 

u(t)  = Z [0.(t)  + 0 L ]u  (t). 
i=l  1 1 

If  the  parameters  are  updated  using  the  law 

0 = -r  ex(t)5(t)  r = rT  > o 


where 

L Vt)  = 5(t),  the  error  e^(t)  0 as  t -*•  00 . 

Proof : 

The  proof  of  stability  of  the  overall  system  and  the  convergence  of  je^(t)| 

to  zero  follow  along  lines  very  similar  to  those  in  case  (i). 

2n  2n  A 2n 

u(t)  = Z PT(0,)a).(t)  = I P_  (9,)(o.(t)  + Z [PT  (*Ja>.(t)] 
i-1  L 1 1 i-1  L 1 1 i«l  L * 1 

2n  ^ 2n 

- Z 0 ai.(O  + £ PT  (♦.)«.  (O. 

i*l  1 i=l  L 1 1 


The  error  equation  (18)  may  now  be  written  as 

2n 

e - A e + b [ Z PT  (<(»  )w  (t)  ] ; e 
«-  c L i i 


(22) 


where  {hT(sI-A  )_1b  } L(s)  = W„(s)L(s) 

C C C M 

and  L 1(s)ta>1(t)  = 5^(0. 


T 

: e « h e 
* 1 c 

T -1 

{h  (sI-A  ) b__  } is  strictly  positive  real 

C C rR 


MODEL 


Figure 


-15- 


It  follows  directly  from  Lemma  1 that 


♦ - -r  ex  e 

will  result  in  |e^(t)|  -*  0 as  t -*■  <».  Since  | Is  bounded,  this  also  Implies  that 
||<j>(t)  H + 0 as  t + «.  Hence  the  auxiliary  signals  4^  L w (t)  (1  = l,2,...,2n) 
into  the  plant  also  tend  to  zero  as  t -*■  00 . 

Comment  1:  While  in  the  above  discussion  the  auxiliary  input  is  fed  into  the  plant, 
it  can  also  be  fed  into  the  model  as  described  in  the  following  section. 

Comment  2:  For  this  case  it  is  seen  that  2n  additional  transfer  functions  of  the 
first  order  are  needed  in  the  controller. 

Case  iii:  With  m($n-3)  zeros  and  n poles  and  known  gain  k : 

V P 

When  k is  known,  by  including  a gain  t—  in  series  with  the  plant, its  gain  may 

p p 

be  adjusted  to  have  any  desired  value  k^.  Hence  without  loss  of  generality  we  can 
assume  that  the  model  gain  is  chosen  to  be  equal  to  that  of  the  plant  i.e.  k^  = k^ 
In  case  (ii)  the  derivative  9(t)  of  the  parameter  vector  is  available  from  the 
adaptive  laws  and  it  is  this  fact  that  allows  the  use  of  the  procedure  outlined.  Un- 
fortunately, this  method  cannot  be  directly  extended  to  the  present  case  since  higher 
derivatives  of  9(t)  are  not  available. 

Faced  with  this  problem  we  develop  an  alternative  approach  which  involves  the 
use  of  the  model  in  the  generation  of  the  adaptive  signals.  Since  a successful 
adaptive  scheme  will  result  in  the  plant  transfer  function  evolving  to  that  of  the 
model  and  in  the  derivatives  of  0^(t) (i=l,2 , . . . ,2n)  tending  to  zero, the  new  algorithm 
calls  for  an  additional  input  to  the  model,as  in  [11],  which  depends  on  these  deriva- 
tives. Specifically,  the  signals  fed  into  the  model  are  such  that  the  form  of  the 
previous  error  equation  (18)  is  preserved. 

If  the  state  equations  of  the  plant  together  with  the  controller  are  given  by 


A x + b [k~r  + <)>T(t)co(t)  ] 
C C Vi 


X 


(23) 
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the  auxiliary  signals  [4>  — P (4> ) ]n> ( t ) (or  [6-P  (0)  ]u>( t) ) are  used  as  inputs  to  the 

L L 


model  in  equation  (17)  resulting  in  the  model  state  equations 


*mc  = Ac  V + VV  + }^(t)  1 


y = h x 
m c me 


(24) 


Since  <p  - P (<p)  = 4>  - L<()L  ^ = L[L  - 4>L  ^],  if  L(s)  is  chosen  to  be  a 

la 


polynomial  in  's'  of  degree  n-m-1  so  that 


{h^(sI-Ac)_1bc}L(s)  = Wm(s)L(s)  = {vJ(sI-Ac)-1bpR} 


is  strictly  positive  real,  the  auxiliary  signals  can  be  realized  without  the  use  of 
differentiators. 

The  model  state  equations  (24)  are  modified  to 


- A x__  + b k*r  + b [L_14>(t)-<Kt)L  1]Tu>(t) . 


me  c me  c 0 PR 


If 


[L“1^i(t)-<^i(t)L_1]a)i(t)  = ^(t) 


(25) 


the  controller  requires  two  transfer  functions  of  order  (n-m-1)  corresponding 
to  each  parameter  that  is  adjusted.  Further,  since  in  this  case,  k^  = 1 


and  only  (2n-l)  parameters  need  to  be  adjusted. 

The  error  equations  corresponding  to  (23)  and  (24)  are 


e - A e + b P ($)  w(t) 

C CL 


UT 

e.  » h e 
1 c 


(26) 


which  are  identical  to  (22)  in  case  (ii).  From  (26)  it  follows  that  the  adaptive 


lJ 


law 


<f>  - -re1(t)?(t) 
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where  L ^(s)u)(ty  = £(t),  as  before,  results  in  bounded  output  error  e^(t)  and 
parameter  errors  $ (t)  (i  = l,2,...,2n). 

It  is  at  this  point  that  we  encounter  a new  stability  problem  which  did  not 
arise  in  the  previous  two  cases.  The  boundedness  of  e^(t)  does  not  assure  the 
boundedness  of  the  plant  and  model  outputs.  The  model  output  now  consists  of  two 
components  - the  desired  bounded  output  and  the  output  due  to  the  auxiliary  sig- 
nals. Since  the  latter  signals  may  be  unbounded,  the  adaptive  scheme  may  result 
in  an  overall  unstable  system.  This  question, whose  resolution  is  essential  to  the 
completion  of  the  adaptive  control  problem^is  discussed  later  in  this  section  in 
greater  detail. 

Case  iv:W  (s)  has  m(<n-3)  zeros  and  n poles;  k unknown: 

E E 

In  (iii)  the  gain  k was  assumed  to  be  known.  Here,  since  the  auxiliary  signal 
P 

corresponding  to  each  parameter  0^(t)  is  fed  into  the  model  (whose  gain  k^  is  dif- 
ferent from  kp),  additional  compensatory  gains  k^(t)  (i  = l,2,...,2n)  are  needed  in 
the  adaptive  controller.  While  the  plant  equations  remain  the  same  as  in  (iii)  the 
model  state  equations  are  modified  to 


x 

me 


Ax  + b [knr  + 
c me  c 0 M 


Ax  + b k r + bDD 

c me  c 0 PR 


2n 

Z 

i=l 

2n 

Z 

i=l 


L(s)k1(t){L_14>i(t)-<t.i(t)L  1>u)±(t)  ] 
kMki(t)ci(t)  (27) 


The  error  equations  may  be  expressed  as : 

2n 

1 . 
e 

c 1_ 

p 


2n  2n 

e-Ae+^-blZ  k <f>  (t)u  (t)]  - b [ Z klc  (t)  C , (t)  J 
c K PR  i=1  P I I PR  Mi  i 


2n 


(27a) 


-1 


Ac®  + bpiJ  1 kpL  “ kMki(t)ti(t)] 


i-1 

[r 

Defining  [1  - — k^(t)]  = i|<  (t)  , (27a)  reduces  to 
P 


-18- 


2n 

e = Ace  + bPR[  £ + <(>^(t)5i(t)] 

e = hTe 
1 c 


Hence  the  adaptive  laws  for  the  4n  parameters  are 


(28) 


4>±Ct)  = -e^Ct) 
i>±M  = -e1^i(t) 


(i  = 1,2,. ..,2n) 
(i  = 1,2,.. .,2n) 


where  by  (20)  and  (25)  L V^t)  = 5±(t)  ; [L_%i(t)  - d>±<t)L  1]a>±(t)  = ^(t) 
and  hence  4n  parameters  and  4n  transfer  functions  L ^(s)  are  needed  in  this  case. 

The  questions  of  stability  raised  in  (iii)  also  apply  here  and  are  considered 
in  the  following. 

The  Stability  of  the  Adaptive  Loop: 

The  arguments  in  (iii)  and  (iv)  lead  us  to  the  central  stability  question  con- 
nected with  the  adaptive  algorithm  suggested  in  this  paper.  We  discuss  this  question 
here  and  make  a conjecture  whose  verification  will  complete  the  solution  to  the 
adaptive  control  problem. 

The  proof  of  boundedness  of  the  output  error  e^(t)  is  relatively  straightforward 

in  all  the  four  cases  discussed  earlier.  In  (i)  and  (ii) , since  the  output  of  the 

model  is  bounded,  the  output  of  the  plant  y (t)  (=  yw(t)  + e(t))  is  also  bounded,  in 

p M 

which  case  e^(t)  + 0 as  t + ®.  In  (iii)  and  (iv)  the  introduction  of  auxiliary  sig- 
nals to  the  model  precludes  such  an  immediate  conclusion.  If  it  can  be  shown  that 
the  plant  output  is  bounded,  then  the  error  e^(t)  will  tend  to  zero  asymptotically 
and, hence  ,the  auxiliary  signals  also  tend  to  zero  as  t + «.  The  model  output  then 
evolves  to  the  desired  output  and  is  followed  by  the  plant. 

The  plant  state  equations  (29)  and  the  system  error  equations  (30)  are: 


x = A x + b [k  r + 4>Tu)] 
c cl) 

UT 

y = h x 
P c 


(29) 
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e = A e + b [P  (<j>)  ] u> 

C C Li 


UT 

e = h e 
1 c 


(30) 


where  the  components  of  ui(t)  are  all  state  variables  of  the  plant.  Hence  (29)  repre- 
sents a feedback  loop  with  (2n-l)  time-varying  parameters  while  (30)  is  an  open-loop 
system  containing  the  same  parameters.  The  fundamental  stability  problem  is  then  to 


conclude  the  boundedness  of  x(t)  from  the  boundedness  of  e(t)  and  <J> ( t) . Since  A 


is  a stable  matrix  and  only  the  boundedness  of  x(t)  is  of  interest,  it  is  sufficient 
to  treat  the  homogeneous  equation  (i.e.  r(t)  e 0 in  (29)). 

The  principal  stability  problem  which  has  to  be  resolved  is  now  stated  as  a 
conjecture. 

A Conjecture:  Let  two  systems  be  described  by  the  differential  equations: 


x = Ax  + bd>  ( t)  Cx 


e = Ae  + b[P  (<(>)  ] Cx 

Lt 


where  A is  an  (nxn)  stable  matrix,  b is  an  n-vector  and  <f>(t)  is  an  m-vector  (m$n) 
of  bounded  continuous  time  functions.  If  e(t)  is  bounded, then  x(t)  is  also  bounded. 

A better  understanding  of  the  implications  of  the  conjecture  can  be  obtained  by 
considering  only  a single  time-varying  parameter  as  shown  in  Figures  5a  and  b.  In 
this  case, the  feedback  system  has  a stable  transfer  function  W(s)  in  the  forward  path 
and  a single  bounded  time-varying  gain  <{> ( t)  in  the  feedback  path.  The  output  of  W(s) 


-1. 


is  y(t)  and  is  the  input  to  the  bounded  linear  operator  [W(s)L(s) <f>(t)L  (s)  ] whose 


output  is  e(t)  as  shown  in  Figure  5a.  The  special  case  when  W(s)L(s)  = — — is  shown 

S"»0l 


in  Figure  5b.  Given  that  e(t)  is  bounded,  then, according  to  the  conjecture, y(t)  is 
also  bounded. 


If  y(t)  is  unconstrained,  its  boundedness  cannot  be  inferred  from  the  bounded- 

-1, 


ness  of  e(t),  where  e(t)  * {WL<f>L  }y(t).  The  basis  for  the  conjecture  lies  in  the 
fact  that  y(t)  has  to  belong  to  the  class  of  signals  generated  by  the  feedback  loop 
shown  in  Fig.  5.  If  is  the  class  of  all  unbounded  signals  defined  for  all  t e [O,00) 


X 


Figure  5a. 
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such  that  {WL<f>(t)L  ^)y  is  bounded  for  y e and  ^ is  the  set  of  a]l  solutions  of  an 
n^  order  linear  differential  equation  with  a single  bounded  time-varying  parameter  4>(t), 
the  conjecture  states  that  is  the  null  set. 

The  application  of  the  conjecture  to  the  adaptive  control  problem  may  be  described 
using  Figure  5c.  According  to  the  conjecture  if  e^(t)  is  bounded,  so  is  the  output  of 
the  plant  y^(t). 

6.  Generalized  Adaptive  Procedure: 

The  method  presented  in  the  previous  section  can  now  be  generalized  to  arbitrarily 
located  control  parameters.  Since  the  same  procedure  can  be  used  for  any  control  param- 
eter, we  shall  merely  consider  the  case  of  a single  adjustable  parameter  in  the  plant. 

The  following  development  is  motivated  in  part  by  a procedure  used  for  the  generation 
of  sensitivity  functions  as  described  in  [12]. 

Let  M represent  the  model  and  P the  plant  in  Figure  6a  and  let  0(t)  be  a control 

Jc 

parameter.  It  is  assumed  that  when  9(t)  = 9 , a constant,  the  transfer  function  of  the 

* * 

plant  is  identical  to  that  of  the  model.  The  plant  with  9(t)  =0  is  denoted  by  P ; 

* * 
if  9(t)  = 9 + <Kt),  the  plant  can  be  represented  as  shown  in  Figure  6b  by  P together 

with  a parameter  4>(t).  For  the  purposes  of  analysis  four  points  1,2, 3, 4 in  Figure  6b 

are  of  interest  and  we  assume  that  the  corresponding  points  l',2',3'  and  4'  in  the  model 

are  also  accessible.  The  open  loop  transfer  function  W^(s)  between  points  1 and  4 is 

equal  to  W^,^,(s)  in  the  model.  The  aim  of  the  adaptive  procedure  is  to  determine  the 

* • II 

rule  for  updating  $(t)(or  equivalently  0 ( t ) ) so  that  lim  |e..(t)|  = 0.  The  four  cases 

t-*» 

that  we  considered  in  the  previous  section  can  now  be  summarized  for  this  general  prob- 
lem as  shown  below.  It  is  worth  pointing  out  that  the  transfer  function  W^(s)(  or 
Wlt^,(s>)  is  of  direct  interest  in  this  case  and  not  the  transfer  functions  V^CsMor 
W2,^i(s)).  However,  for  ease  of  exposition,  we  shall  assume  that  points  1 and  2 coin- 
cide (i.e.  the  output  of  the  adjusted  parameter  is  fed  back  to  the  input)  so  that 
W^4 (s)  » t^Cs).  In  this  case  all  the  conditions  can  be  stated  in  terms  of  W2>4*^s^  or 
the  model  transfer  function.  For  the  more  general  case  where  points  1 and  2 do  not 
coincide^ W^(s)  in  the  following  discussion  must  be  replaced  by  W^,^,(s). 
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W s3+6s2+lls+6 

INPUT : Square  wave 
Amplitude  : 5 units 
Frequency  = I hz 
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(PLANT)  Wp(»).-s3t6s2,7$_4 

( MODEL)  WM  (s ) * ' 3 ~ g 

W s3+  68z+  lls+  6 

INPUT:  Square  wave 
Amplitude  : 5 units 
Frequency  s 2 hz 
L (s  ) s s+1.5 


CONTROL  OF  UNSTABLE  PLANT 
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I 


lJ 


INPUT.  Square  wave 
Amplitude : 5 units 
Frequency  « 1.5  hz 


MODEL 


Figure  12b. 


(i)  WM(s)  e {SPR>: 
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The  adaptive  rule 

<Kt)  = -e1(t)w1(t) 

where  u>^(t)  is  the  input  to  the  parameter  being  adjusted  assures  that  |e^(t)|  + 0 as 
t » by  the  direct  application  of  lemma  1.  The  evolution  of  the  parameter  to  its  fi- 
nal value  and  the  error  e^(t)  to  zero  for  stable  and  unstable  plants  is  shown  in 
Figs.  7a, b. 

(ii)  WM(s)(s+p)  e (SPR): 

When  W (s)  is  such  that  W__(s)(s+p)  can  be  made  strictly  positive  real  by  the  prop 
er  choice  of  a constant  p,  an  additional  stabilizing  signal  is  fed  into  the  plant  as 
shown  in  Figure  4.  The  signal  is  proportional  to  <J>(t)  and  tends  to  zero  as  the  adapta 
tion  progresses.  The  adjustment  of  a single  parameter  using  this  scheme  is  shown  in 
Figs.  8a, b for  both  stable  and  unstable  plants. 


(iii)  WfsJUs)  e {SPR}: 

PI 


When  a polynomial  L(s)  (of  degree  >,  2)  exists  such  that  W L is  strictly  positive 

M 

real,  the  stabilizing  signal  {0-P  (9)}oj  is  fed  into  the  model  as  shown  in  Fig.  9. 

L 1 

The  model  is  suitably  modified  so  that  this  can  be  accomplished  without  the  use  of 
differentiators.  The  evolution  of  the  feedback  parameter,  the  stabilizing  signal  and 
the  output  error  is  shown  in  Figures  10a, b for  both  stable  and  unstable  plants. 


k 

(iv)  Wp(s)  = ^ WM(s);WM(s)L(s)  e {SPR>: 


If  the  transfer  function  between  points  1 and  4 in  the  plant  is  the  same  as  that 

of  the  model  except  for  a constant  gain,  an  additional  gain  is  needed  in  the  path  of 

the  stabilizing  signal  in  (iii), (Fig.  11).  The  evolution  of  the  feedback  parameter 
* 

9(t)  to  the  value  6 , the  stabilizing  signal  5(t)  and  the  output  error  is  shown  in 
Figure  12a, b for  both  stable  and  unstable  plants. 

7 . Further  Simulation  Results: 

Extensive  simulations  of  the  control  problem  on  the  digital  computer  indicate 
that  the  procedures  outlined  in  the  previous  sections  do  result  in  a robust  controller 
with  the  output  error  |e^(t)|,  as  well  as  the  stabilizing  signal  |?(t)|,  tending  to 
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zero  at  rates  which  are  practical.  In  view  of  the  fundamental  theoretical  questions 
that  arise  in  the  stability  analysis  of  the  adaptive  system,  these  simulation  studies 
prove  invaluable  in  providing  insight  into  the  nature  of  the  adaptive  controller.  In 
this  section  we  present  simulation  results  for  a third  order  system  for  the  four  cases 
described  in  section  5.  The  plant  and  model  transfer  functions  for  the  four  cases  are 
given  in  Table  I. 

TABLE  I 


CASE 

PLANT  W (s) 

P 

V8> 

s2  + 5s  + 4 

2(s2  + 4s  + 3.75) 

v.i7 

3 2 

3 2 

s + 9s  + 24s  + 20 

s + 6s  + 11s  + 6 

(ii) 

s + 4 

2(s  + 1.5) 

s3  + 9s2  + 24s  + 20 

3 2 

s + 6s  + 11s  + 6 

(iii) 

1 

1 

s^  + 9s2  + 24s  + 20 

s3  + 6s2  + 11s  + 6 

(iv) 

1 

2 

3 2 

3 2 

s + 9s  + 24s  + 20 

s + 6s  + 11s  + 6 

In  cases  (i)  and  (ii)  six  parameters  are  adjusted  while  in  case  (iii)  only  five  control 
parameters  are  needed.  However,  in  the  last  case,  twelve  parameters  have  to  be  ad- 
justed, six  of  which  represent  the  extra  gains  discussed  in  section  5.  To  generate  the 
auxiliary  signals,  and  are  used  with  characteristic  polynomials 

A(s)  = s2  + 4s  + 3.75 

The  reference  input  r(t)  in  each  case  was  a square  wave  with  an  amplitude  of  5 unita 
and  frequencies  ranging  from  .5  hz  to  6 hz.  (Figure  13). 
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( PLANT ) WD  ( s ) s —= — — - 

p s3  + 9s2  + 24s  + 20 


(MODEL)  WM(s) 


s3+  6s2  + I Is  ♦ 6 

INPUT : Sum  of  twelve  sinusoids 
with  frequencies  ranging 
from  . 5 hz  to  .6  hz 
Max.  Amplitude  : 5 units 

L(s)  * (s+1.5 )(s+2.5) 


6 8 
t in  seconds 

Figure  13 (iv). 
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